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Abstract. This article is concerned with stability analysis and stabilization of randomly 
switched systems under a class of switching signals. The switching signal is modeled as a jump 
stochastic (not necessarily Markovian) process independent of the system state; it selects, at each 
instant of time, the active subsystem from a family of systems. Sufficient conditions for stochastic 
QQ i stability (almost sure, in the mean, and in probability) of the switched system are established when 

, the subsystems do not possess control inputs, and not every subsystem is required to be stable. 

f**^ ■ These conditions are employed to design stabilizing feedback controllers when the subsystems arc 

^v^j affine in control. The analysis is carried out with the aid of multiple Lyapunov-like functions, and 

the analysis results together with universal formulae for feedback stabilization of nonlinear systems 
G ' constitute our primary tools for control design. 

3 ' 
I—* 

U 

■ 1. Introduction. A randomly switched system has two ingredients, namely, a 

fH | family of subsystems and a random switching signal. In this article we are inter- 

ested in finding conditions for stochastic stability of randomly switched systems. Our 
approach consists of identifying key properties of the family of subsystems and the 
switching signal, and finding conditions to connect them such that the switched sys- 
tem has the desired characteristics. We concentrate on stability almost surely and in 
expectation. Since each of these implies stability in probability [13, 17, 16], our re- 
sults immediately provide sufficient conditions for weak stability in probability of the 
systems under consideration; we also demonstrate that the conditions are sufficient 
for strong stability in probability. 

The basic structure of our main analysis results is as follows. The first step 
involves extracting properties which quantitatively express stability characteristics 
of the subsystems. This is carried out with the help of multiple Lyapunov functions. 
The method of multiple Lyapunov functions was developed originally in the context of 
deterministic switched systems, and is discussed in detail in, e.g., [19, Chapter 3]. This 
method is effective in quantitatively capturing the degree of stability (or instability) 
of the subsystems. The second step involves extracting key properties of the switching 
signal. These properties are variously captured by the probability mass function of 
its rate of switching, the probability distribution of its jump destinations, distribution 
of holding times between switching instants, etc. Finally, the characteristics of the 
switched system generated by the switching signal from the family of subsystems are 
captured by inequalities which connect the above two sets of properties. 

Research on randomly switched systems has concentrated mostly on the case of 
Markovian switching signals — the discrete state evolves according to a continuous- 
time Markov chain; see e.g., [9, 29] and the references cited therein. The central idea 
behind arriving at stability conditions revolves around employing the generator of the 
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Markov process and extracting certain nonncgativc supcrmartingales that converge 
to zero in expectation. This method in turn is based on the martingale problem [10, 
Chapter 5] corresponding to the Markov process. In its simplest form, if (X t )t^>o is 
the underlying Markov process with generator £, (X consists of both the continuous 
and the discrete states,) then for every measurable and bounded real- valued function 
V on the state space, the process (Y t ) t ^ defined by Y t := V{X t ) — J Q CV(X s )ds is 
a martingale. A pointwise inequality which bounds CV(-) on the state space may be 
imposed, and with the help of this one can draw conclusions about stability properties 
of the system by analyzing the martingale above; this analysis becomes particularly 
simple if V is a nonnegative Lyapunov-like function. 

The martingale approach described above can be applied to switched systems in 
which the switching signals are general point processes with intensity functions satis- 
fying certain standard measurability conditions; see e.g., [4] for further details on the 
measurability conditions. These intensity functions appear in the expression of CV 
in place of the usual Markov transition intensity matrix, and hereafter the analysis 
follows that of the Markovian case. However, for non-Markovian switching signals, it 
is not easy to employ this technique; for instance, if the holding times between con- 
secutive switching instants are independent and identical uniform random variables, 
obtaining expressions of these intensity functions is difficult. The methods we propose 
here apply to scmi-Markovian switching signals, do not depend on martingale anal- 
ysis, and arrive at the results directly by employing what we think arc less involved 
and more intuitively appealing techniques. Existing work on stability of stochastic 
switched systems includes [23, 28, 27, 5, 3, 9, 11, 15, 14, 1]; see also [6, Chapter 1] for 
a survey techniques employed in these articles. 

Analysis results obtained via our approach, including those reported in our earlier 
article [7] where each subsystem was required to be stable, have conceptual analogs in 
deterministic switched systems theory. The approach pursued in [7] and in the current 
article is derived from the method of multiple Lyapunov functions developed in the 
context of deterministic switched systems, sec e.g., [19, Chapter 3] for an extensive 
discussion. Stability of individual subsystems and a slow switching condition are the 
important features of these deterministic results. In this article our results involving 
unstable subsystems employ certain probabilistic characteristics of the switching sig- 
nal in addition to slow switching; their conceptual analogs in deterministic switched 
systems literature are comparatively less known, with the exception of [30] . 

With our analysis results in hand, we turn to control synthesis and derive explicit 
controller formulas which ensure stability of the switched system in closed loop. In this 
context, there naturally arise two distinct cases: one in which the controller has full 
knowledge of the switching signal at each instant of time, and the other in which the 
controller is totally unaware of the switching signal. We examine the distinctive fea- 
tures of each of these two cases and propose control synthesis strategies by employing 
universal formulae [26, 20, 21, 22] for nonlinear feedback stabilization. The advan- 
tages of our approach are evident here, for one does not need to design a controller 
separately for the switched system if there already exist control-Lyapunov functions 
for each individual subsystem; then, off-the-shelf controllers employing universal for- 
mulae are easily designed, and a modular organization of the controller synthesis stage 
is facilitated. 

The article unfolds as follows. §2 presents the system model with no inputs 
and the stability concepts under consideration. The main analysis results appear 
in §§3, 4, and 5, and their proofs are given in §6. The controller synthesis results 
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are presented in §7. We conclude in §8 with a brief discussion of possible channels of 
further investigation. 

Some notation: Let IR^o denote the nonncgative half-line [0, oo[, N = {1, 2, . . .}, 
No := N U {0}, and let ||-|| denote the Euclidean norm. 

2. Preliminaries. We define the family of systems 

x = fi(x), i£V, (2.1) 

where the state x £ M" , V is a finite index set of N elements: V = {1, .. . , N}, the 
vector fields fa : M" — > M™ are locally Lipschitz, and /i(0) = 0, i £ V- 

Let (f2, 3", P) be a complete probability space. Let a :— (c(i))t^o be a cadlag (i.e., 
right-continuous and possessing limits from the left) stochastic process taking values 
in V, with <r(0) completely known. The process a is by definition measurable [25, 
Chapter 1]. Let the discontinuity points of a be denoted by n, i £ N, and let 
to := by convention. The filtration (3t)t^o generated by a is right-continuous [4, 
Theorem T26, p. 304], and we augment Jo with all P-null sets. As a consequence of 
the hypotheses of our results, the sequence (ri)i £ N is almost surely divergent, i.e., a 
is nonexplosive. The randomly switched system generated by this switching signal a 
from the family (2.1) is 

x = U(x), (x(0),(t(0)) = (xo,(to), i>0. (2.2) 

We assume that there are no jumps in the state x at the points of discontinuity of the 
switching signal; we shall henceforth refer to these points as the switching instants. 
The above hypotheses on the system (2.2) and a ensure that standard conditions 
for the existence and uniqueness of an absolutely continuous solution in the sense of 
Carathcodory [12], over a nontrivial time interval containing 0, are fulfilled for almost 
every sample path. Existence and uniqueness of a global solution will follow from 
the hypotheses of our results. We let x(-) denote this solution. For xq = 0, the 
solution to (2.2) is identically for every a; we shall ignore this trivial case in the 
sequel. Standard arguments (see e.g, [6, Chapter 1]) show that the solution process 
x(-) of (2.2) is an (3 r t)t^o-adapted process. 

Recall [2] that for A > 0, an exponential-(A) random variable £ has the distribution 
function P(£ ^ s) = 1 — e~ As for s ^ 0, and otherwise; for T > 0, a uniform-(T) 
random variable £ has the distribution function P(£ ^ s) = if s < 0, s/T if s £ [0, T], 
and 1 otherwise. A continuous function a : K.j»o — y IK^o is of class-/C (we write 
a £ JC) if it vanishes at and is monotone strictly increasing. A continuous function 
fi : R^o x Rjso — * R^o is of class-/C£ (we write (3 £ ICC) if (3(r, •) is monotone strictly 
decreasing for each fixed r, and /?(-, s) is of class-/C for each fixed s; we write £ ICC. 

We focus on the following two properties of (2.2); see e.g., [13]. 

Definition 2.1. The system (2.2) is said to be globally asymptotically stable 
almost surely (GAS a.s.) if the following two properties are simultaneously verified: 

(AS1) P(Ve > 36 > such that \\x \\ < 5 =s> sup < e ] = I; 

(AS2) P^Vr,e' > 3T ^ such that \\x \\ < r => sup||x(i)|| < = 1. 

Let us note that this property is well-defined because each of the sets appearing 
inside the measure P is J-measurable due to continuity of x(-). 

Definition 2.2. The system (2.2) is said to be a-globally asymptotically stable 
in the mean (a-GAS-M) for a function a £ JC if the following two properties are 
simultaneously verified: 
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(SMI) Ve > 36 > such that \\x \\ < S => sup E[a(||x(i)||)] < e; 

(SM2) Vr,e'>0 3 f > such that \\x Q \\ < r => supE[a(||x(i)||)] < s' . 

Stability definitions in deterministic systems literature usually involve just the 
norm of the state. The presence of the function a in Definition 2.2 allows some 
measure of flexibility in the sense that one need not worry about bounds for just 
the expectation of the norm of the state, i.e., .Li-stability. Frequently one employs 
Lyapunov functions which are polynomial functions of the states, and with the aid of 
conditions such as (VI) in Assumption 2.3 below, stronger bounds in terms of the L p 
(p > 1) norms of the state are obtained. For instance, quadratic Lyapunov functions 
yield bounds for mean-square or Instability, which is stronger than Li-stability. 

Our analysis results employ a family of Lyapunov functions, one for each sub- 
system. The following assumption collects the properties we shall require from the 
members of this family of Lyapunov functions. 1 For notational brevity, we let LfV(x) 
denote the Lie derivative of a diffcrcntiable function V : R™ — > ffi along a vector field 
/ : R n — > R'\ i.e., L f V(x) := (V x V(x), f(x)). 

Assumption 2.3. There exist a family of continuously differ entiable real-valued 
functions {Vi\nz-p on W 1 , functions ai,(X2 G /Coo, numbers p > 1 and A; G R, i € V, 
such that for all x G R n and i,j 6 V , 
(VI) ai (\\x\\)^V(x)^a 2 (\\x\\); 
(V2) L f .Vi(x) < -XiViix); 
(V3) Vi(x) ^ fiVjix). 

Remark 2.4. (VI) is a fairly standard hypothesis, ensuring each Vi is positive 
definite and radially unbounded. The condition in (V2) keeps track of the growth of i- 
th Lyapunov function Vi along the vector field fi of the i-th subsystem; the parameter 
Xi provides a quantitative estimate of this growth rate. The right-hand side of the 
inequality in (V2) being a linear function of Vi is no loss of generality, see e.g., [18, 
Theorem 2.6.10] for details. (V3) certainly restricts the class of functions that the 
family {Vi}i^-p can belong to; however, this hypothesis is commonly employed in 
the deterministic context [19, Chapter 3]. Quadratic Lyapunov functions universally 
utilized in the case of linear subsystems always satisfy this hypothesis. 

3. Main Results. In this section we present our main results providing suffi- 
cient conditions for GAS a.s. and ai-GAS-M of randomly switched systems under two 
different classes of switching signals. The switching signals described here are fairly 
general and are quite natural to consider. 

We let (5i)i £ N, Si := — r,_i be the sequence of holding times, where (r^jgpj is 
the sequence of discontinuity points of a. 

Definition 3.1. We say that the switching signal a belongs to 
• class EH if: 

(EH1) the sequence (Si)igN of holding times is a collection of independent and 
identically distributed (i.i.d) random variables, with Si an exponential-(X) 
random variable, A > 0; 

(EH2) 3qi E [0, 1], i G V, such that Vj G N, p(ct(tj-) = i\{<y{r k )y^) = QH 

(EH3) the sequences (Si)^ and (cr(Tj))igN are mutually independent. 



1 Strictly speaking we should call them "Lyapunov-like functions," because their gradients do not 
necessarily decrease along the corresponding system trajectories. For simplicity we shall adhere to 
the term "Lyapunov functions" in the sequel. 
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• class UH if: 

(UH1) the sequence (S'i)igN of holding times is a collection ofi.i.d random variables, 
with Si a uniform-(T) random variable, T > 0; 



(UH3) the sequences (Si)i^tn and (o-(ri))i^ are mutually independent. 

The following arc our main results; their proofs are provided in §6. 

Theorem 3.2. The system (2.2) is GAS a.s. if 
(El) Assumption 2.3 holds; 

(E2) the switching signal a belongs to class EH as defined in Definition 3.1; 
(E3) Aj + A > V* e V; 



Corollary 3.3. The system (2.2) is ai-GAS-M under the hypotheses of Theo- 
rem 3.2. 

Theorem 3.4. The system (2.2) is gas a.s. if 
(Ul) Assumption 2.3 holds; 

(U2) the switching signal a belongs to class UH as defined in Definition 3.1; 



Corollary 3.5. The system (2.2) is ai-GAS-M under the hypotheses of Theo- 
rem 3.4- 

Remark 3.6. Let us first note that switching signals of class EH and UH are 
nonexplosive, i.e., there are finitely many jumps on finite- length intervals of time 
almost surely. Indeed, it follows immediately from the Strong Law of Large Num- 
bers [24, Theorem 7, p. 64] that since (Si)jgN is i-i-d and ETiSj G ]0,oo[ for switching 
signals belonging to either class EH or UH, almost surely the z/-th jump instant 
t„ = Yli=i & — * oo as v —> oo. It is also readily seen that switching cannot stop 
after a finite time, for then Sj = oo for some j, and the probability of the event 
{Sj = oo for some j} is 0. 

Remark 3.7. Let us examine the statement of Theorem 3.2 in some detail. 
Firstly, note that by (El) not all subsystems are required to be stable, i.e., for some 
i G V, Xi can be negative; then (V2) provides a measure of the rate of instability of 
the corresponding subsystems. Secondly, note that condition (E3) is always satisfied 
if each Xi > 0. However, if A; < for some i G V, then (E3) furnishes a maximum 
instability margin of the corresponding subsystems that can still lead to GAS a.s. 
of (2.2). Intuitively, in the latter case, the process N a (t,0) must switch fast enough 
(which corresponds to A > being large enough,) so that the unstable subsystems 
are not active for too long. Potentially this fast switching may have a destabilizing 
effect. Indeed, it may so happen that for a given (x, a fixed probability distribution 
{qi}i £ -p, and a choice of functions {Vi}i<z-p, (E3) and (E4) may be impossible to 
satisfy simultaneously, due to a very high degree of instability of even one subsystem 
for which the corresponding qi is also large. Then we need to search for a different 
family of functions {Vi}i^-p for which the hypotheses hold. Thirdly, (E4) connects the 
properties of deterministic subsystem dynamics, furnished by the family of Lyapunov 
functions satisfying Assumption 2.3, with the properties of the stochastic switching 
signal. From (E4) it is clear that larger degrees of instability of a subsystem (small 
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Aj) can be compensated by a smaller probability of the switching signal activating the 
corresponding subsystem. 

Remark 3.8. Let us make some observations about the statement of Theo- 
rem 3.4. Once again, just like Theorem 3.2, note that by (Ul) not all subsystems 
are required to be stable, i.e., for some i £ V, Xi can be negative. (U3) connects the 
properties of deterministic subsystem dynamics, furnished by the family of Lyapunov 
functions satisfying Assumption 2.3, with the properties of the stochastic switching 
signal. Also from (U3) it is clear that larger degrees of instability (larger Ai) of a 
subsystem can be compensated by a smaller probability (smaller qi) of the switching 
signal activating the corresponding subsystem. Notice that a switching signal of class 
UH is semi-Markov [2, Section 20.4]. There is a strong dependence on past history 
due to the uniform holding times. Indeed, at an arbitrary instant of time t we need 
to know how long ago the last jump occurred in order to compute the probability 
distribution of the next jump instant after t. 

Remark 3.9. It may be observed that Theorem 3.2 requires a larger set of 
hypotheses compared to Theorem 3.4; however, this is only natural. Indeed, the 
switching signal in the latter case is constrained to switch at least once in T units of 
time, whereas no such hard constraint is present on the switching signal in the former 
case. We observed in Remark 3.7 that it is necessary for the switching signal to switch 
fast enough if there are unstable subsystems in the family (2.1), which necessitated 
the condition (E3). This fast switching is automatic if a is of class UH, provided 
T is related to the instability margin of the subsystems in a particular way. The 
condition (U3) captures this relationship, for, observe that if Ai is negative and large 
in magnitude for some i € ?, the ratio (l — e _AiT ) /(A,T) is smaller for smaller T, 
and a smaller ratio is better for GAS a.s. of (2.2). Also for a given T, large and positive 
Ai's (i.e., subsystems with high margins of stability) make the aforesaid ratio small. 

4. A Generalization. The results in §3 fall short of being completely satis- 
factory. In particular, the assumption of the jump destinations process (cr(7i))i g N 
being mcmoryless (assumptions (EH2) and (UH2)) is perhaps the most restrictive. 
As we observed in Remark 3.8, switching signals of class UH fall in the class of semi- 
Markov processes, in fact trivially so, due to the memoryless nature of the discrete 
jump-destination process (a(Ti))i e n. However, it would be better if we could handle 
the Mar kovian jump destination case by keeping the other two hypotheses intact. In 
this section we do that, namely, include those switching signals for which the process 
(c(ri))i 6 N is a discrete-time Markov chain. Although the results given in this section 
are not the most general possible, they are intended to highlight the directions of 
possible generalizations that can be made in our framework. 

Assumption 4.1. There exist a family of continuously differentiate real-valued 
functions {Vi\nz-p on W 1 , functions ol\,oli £ /Coo, numbers fx > 1 and A 2J £ R, 
i, j £ V , such that for all x £ R™ and i,j £ V , 
(VI') (VI) of Assumption 2.3 holds; 
(V2') LfjViW^-XiMx); 
(V3') (V3) of Assumption 2.3 holds. 

Definition 4.2. We say that the switching signal a belongs to class GH if: 

(GH1) the sequence (Si)i^n of holding times is an i.i.d collection of random variables, 
with E \Si\ < oo; 

(GH2) the process (a(Ti))i^jq is a discrete-time Markov chain with initial probability 
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vector 2 ^{<x } and transition probability matrix P = \Pi,j]-pxv> 
(GH3) («Si)» e j| is independent of (cr(rj)) ieNo . 

Switching signals belonging to class GH are semi-Markov [2, Section 20.4]. In 
the most general case of a semi-Markov process, the sequence (Si)ieN in (GH1) may 
be such that the distribution of Si depends on both cr(ri_i) and cr(rj), i 6 N. Our 
objective here is to illustrate some new techniques, and hence we shall retain the 
simpler condition (GH1) at the expense of lesser generality. The condition (GH2) 
imposes a discrete-time Markovian structure on the process (a(Ti))i(zjq 01 and the con- 
dition (GH3), though not the most general, is a standard hypothesis for semi-Markov 
processes. 

Theorem 4.3. The system (2.2) is gas a.s. if 
(Gl) Assumption 4- 1 holds; 

(G2) the switching signal a belongs to class GH as defined in Definition 4-2; 
(G3) 3 6 G [0,1[ such that 

jev 

Remark 4.4. Switching signals of class GH are nonexplosive, and switching 
cannot stop in finite time, as can be seen by following the same line of reasoning as 
in Remark 3.6. 

Remark 4.5. Note that Theorem 4.3 is conceptually quite different from the 
results of §3. Indeed, the condition (G3) involves the growth rate of a Lyapunov 
function along every subsystem, in contrast to the results in §3, where we only kept 
track of the growth rate of each Lyapunov function along the trajectories of the 
corresponding subsystem. This additional factor is due to the Markovian nature of the 
jump destination process (cr(Ti))igN > an( i quite naturally the transition probabilities 
Pi,j:hj £ "P appear in (G3). Also, the condition (V2') requires us to keep track of the 
behavior of every Lyapunov function at once; in a way we quantify how each subsystem 
relates to the others through the inequality in (V2'). This is a deviation from our 
philosophy of decoupling the properties of the switching signal from the properties of 
the individual subsystems at first and then connecting them. The Markovian nature 
of the jump destination process in Theorem 4.3 does not seem to entirely allow this 
separation. 

5. An Excursion into Global Asymptotic Stability in Probability. Among 
the several notions of stochastic stability in the literature, one particular notion that 
encodes uniform behavior of system trajectories is strong global asymptotic stability 
in probability (s-GAS-p). Recall [13] that 

Definition 5.1. The system (2.2) is strongly globally asymptotically stable in 
probability if the following two properties are simultaneously verified: 

(i) Vr? e ]0,1[ Ve > 35 > such that \\x \\ < 5 => P ( sup ||ar(t)|| > e J rj; 

(ii) Vy 6 ]0,1[ Vr,e' > 3T > such that \\x \\ < r =*> pf sup ||a;(i)|| > e'J sC rj '. 

Let us note that each of the sets inside the measure P in (i) and (ii) above is 
^-measurable due to continuity of x(-); the notion is therefore well-defined. An equiv- 
alent statement may be made up in terms of class- ICC functions: the system (2.2) satis- 
fies the strong global asymptotic stability in probability property (s-GAS-p) if for every 



2 Here S^y denotes the Dirac measure concentrated on {j}. 
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i] e ]0,1[ there exists a function (3 G KC such that P( \\x{t)\\ ^ I3{\\x \\ ,t) Vi > 0) ^ 
1 — r/. In the context of randomly switched systems this property can be derived from 
GAS a.s. with the aid of the local Lipschitz property of the vector fields. We state this 
in the following proposition, whose proof is provided in §6.3. 
Proposition 5.2. // (2.2) is GAS a.s., then it is s-GAS-P. 

In particular, the hypotheses of Theorem 4.3, Theorem 3.2 and Theorem 3.4 each 
imply s-GAS-P of (2.2). 

6. Proofs of the Analysis Results. The proofs of the theorems and corollaries 
of §3 and §4 are documented in this section. In order to simplify the presentation, a 
number of technical lemmas are stated and proved first in §6.1, followed by the proofs 
of the main results in §6.2. We carry out the proofs of Theorem 3.4 and Corollary 3.5, 
both dealing with switching signals of class UH, in complete detail below. The proofs 
of Theorem 3.2 and Corollary 3.3 dealing with switching signals of class EH arc similar 
and are sketched. We retain the notations and conventions of §2. Let us recall some 
basic definitions and results. 

Let / be a nonempty index set. A family of real-valued random variables {£i}ie_r 
is said to be uniformly integrable [24, Definition 3, p. 23] if 

lim sup E[ |&| l{| ?i |> c }] = 0. 

The following Hadamard-de la Vallee Poussin criterion [24, Theorem 5, p. 24] for 
checking uniform intcgrability of a family of random variables will be employed later. 

Proposition 6.1 (Hadamard-de la Vallee Poussin). A family of real-valued 
integrable random variables is uniformly integrable if and only if there exists 

a convex function <j) : K > R^o with 0(0) = and linv^oo <f>{r)/r = oo ; such that 

suPie/ E[0(&)] < oo. 

Recall that a family of random variables (£t)t^o converges almost surely (a.s.) if 
it converges pointwise outside a P-null set. The following Proposition is standard, it 
can be readily derived from the Vitali convergence theorem [24, Theorem 4, p. 24]. 

Proposition 6.2. // (^t)t^o is a eddlag (i.e., right- continuous and possessing 
limits from the left) random process on the filtered probability space above, (£t)tj;o is 
uniformly integrable, and (£t)t^o converges to a.s., then (E[£t]) t>0 converges to 0. 

We need Egorov's theorem on almost uniform convergence of a sequence of mea- 
surable functions (see e.g., [24, Theorem 4, p. 50] for a proof). 

Theorem 6.3 (Egorov). Let {g n ) n &i be a seguence of measurable functions on 
(fi,^, P) and g„ — > g a.s. Then for every e > there exists a measurable set A £ with 
P(0\A e ) < e such that (5nl J 4 e ) ngN converges uniformly to glA c - 

6.1. Auxiliary lemmas. 

Lemma 6.4. The system (2.2) has the following property: for every e > there 
exists L e > such that 

In particular, l] e [(x(i)) \\x(t)\\ < ||x || e iet Vt ^ 0. 

Proof. Since is a finite family of locally Lipschitz vector fields, there exists 

some e" > and L s » > such that 



d\\x(t)\\ 
dt 



^L £ \\x(t)\\. 



(6.1) 



sup \\fi(x)\\ < L e „ \\x\\ 
iev. 
IM|e[o,e"[ 
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Let e := e' A e" . Note that Vx e K n \{0} we have 



d|M| 2 






<2\\x\\ 


dx 










dt 




dt 


dt 



and 



d 11x11 



These two inequalities lead to 
larly, 

dllxl 1 



d||a|| 



dt 



211x11 



dx 
dt 



d||x|| 



(If 



The inequality in (6.1) follows. Simi- 



df 



Vx e {x <s 



<e}\{0}. 



(6.2) 



An application of a standard differential inequality [18, Theorem 1.2.1] indicates that 
every solution x(-) of (2.2) satisfies 



\W)\\ ^IMIe*-* 

so long as ||x(t)|| < e. This proves the claim. □ 

The following Barbalat-type lemma was stated without a complete proof in [7] . 
It allows us to assert asymptotic convergence of ||x(-)|| from the finiteness of a certain 
integral of ||x(-)|| . 



Lemma 6.5. If a £ K, and 



a(\\x(t)\\) dt < oo a.s., then lim ||x(f)|| — a.s., 

t — >oo 



where x(-) is the solution of (2.2). 

Proof. Suppose that the claim is false. Then there exists a measurable set D of 
positive probability such that for every event in D there exists some e' > and a 
monotone increasing divergent sequence (si)jgpf in M^o such that a(||x(sj)||) > e' for 
all i. By the finiteness condition on the integral in the hypothesis, almost surely there 
exists T(e) > such that 



T(e) 



a(\\x(t)\\)dt<± 



2 6 



ds, 



(6.3) 



where the right hand side is a strictly positive quantity since a G /C. For every event 
on a set of positive probability we have assumed that (sj)jgN is a monotone increasing 
divergent sequence with a(||x(sj)||) > e, and therefore there exists i(e) £ N such that 
Sj( E ) > T(e) with strictly positive probability. By continuity of ||-|| and x(-), there 
exists an instant t' > Sj( £ ) such that ||x(t')|| = e/2, also with positive probability. But 
since x(-) solves (2.2), Lemma 6.4 holds, and by (6.1) we have ||x(t)|| € ]0,e[ for all 
te]t',t'+"[. Therefore 



a(\\x(t)\\)dt> 



a\ -e 

2 



-L e (t-t' 



dt 



with positive probability, which is a contradiction in view of (6.3). The assertion 
follows. □ 

Lemma 6.6. Under the hypotheses of Theorem 3.4, for each j £ N we have 
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f+Hq. (1 _ e -\,(i+«)T) 
where r){K) := > ; — — — ; — — , n > 0. 



jev 



Aj(1 + k)T 



Proof. Pick i € No. For £ 6 [ri,rj+i[, from (V2) we have 

< K(r I+1 )(^(^))e- A -^ )(t - ri) , 
and by continuity of x(-) and each Lyapunov function, and (V3), 

y^ +1 Mt)) < ^ ( r ! )(^(^))c- A "^» ( *- Ti) 

pointwisc on f2. Fix j £ N. For k > 0, iterating the above inequality and employing 
the independence hypothesis (UH3) and (VI), we have 



n 



l + K 



/to 



-^<rf T j 1 Si- 



(6.4) 



«2 +K (ii^ii)n^ i+K E 



But 



-A„ (T . )(l+K)S i+ l 



E 



^^L-A CT(Tl )(i+«)Si + i 

Jo T 

1 _ e -\,K)(l+K)T 

% (l-e- A ^ 1+K ) T ) 



Ai(l + «)T 



(6.5) 



Substituting the right hand side of (6.5) in (6.4) leads to 



\iE"P 



\ 1 {1 + k)T 



and considering the definition of tj(k) the assertion follows. □ 

Lemma 6.7. Under the hypotheses of Theorem 3.4 we have I ai(||x(£)|| ) d£ < oo 



Proof. For a fixed £ £ R^o we have 



E[V CT(t) 0r(£))] =E 



J2v„ (t) (x(t))l 



{te[r,,r i + 1 [} 



i=0 



J2 E [ V °(t)(x(t))l {t e[T t ,T l+1 [}] , 



(6.6) 
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where we have employed the monotone convergence theorem [24, Theorem 1, §1.3] to 
get the second equality. An application of (VI) and Tonclli's theorem [24, Theorem 11, 
§1.3] gives us 



ai (\\x(t)\\)dt 



V a{t) (x(t))dt 



/ E[V a{t) (x(t))] dt, (6.7) 
Jo 



and in conjunction with (6.6) we obtain 



ai(||x(t)||)dt 



nOC °° 

< / ^ E [Va(tMt))l {te[TitTi+l}} ] dt. 



A second application of monotone convergence theorem on the right hand side of the 
above leads to 



ai (\\x{t)\\) dt 



<E / E [^r(t)(z(*))l{te[T 4 ,r« +1 [}] d *> 

i-n JO 



and a further application of Tonclli's theorem on the right hand side gives 

00 poo 00 r poo 

J2 E [^(t)(a:(*))l{t€[T i> T i+1 [}] M = J2 E / V <r(tMt))l mTitT „ lU dt 



(6.8) 



Each term in the series on the right hand side of (6.8) may be estimated as follows: 



V ai t)(x(t))l{t & [ Ti ,T i+1 l} dt 



by (V2), and therefore 





[L 







K(r ! )(^(^))e" A " < ^ )(t " ri) l{ te [r ! ,r I+1 [} dt 



V a{t) (x(t))l {te[n , Ti+l[} dt 



T i + 1 



V^ixin^e-^^-^ dt 
1 - c -K( Ti )Si+i 



V<r( Ti )(x(Ti)) 

V a{Ti) {x{n)) 



1 - E 5Ti [e _A -(^' s ' i+1 



Acr(Ti) 



Wj) A_ 1 
<me[7 jW (i(h))] , 



r 



" A -(-.) s ds 



_ e - A ^( Ti ) T 



(6.9) 



where M :— maxjg-p 



^- — 1 °^ T ' j is a well-defined positive real number because 
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of the finiteness of V. From (6.8) and (6.9) we get 



ai(||x(t)||)di 



J2 E 



V<r(t)(x(t))l{ t€ [ Ti , ri+1 [} dt 



^ Ma 2 (\\x \\)J2E[V <Ti) {x(n))] 



i=0 



^Ma 2 (\\x \\)Y,V l (0) 



i=0 



< 00, 



where r\ is as defined in Lemma 6.6, and rj(0) £ ]0, 1[ by (U3). This establishes the 
claim. □ 

Lemma 6.8. Under the hypotheses of Theorem 3.4, the family of random variables 
\V a (t)(%(t))} t>0 is uniformly integrable. 

Proof. To establish uniform integrability of the family {V a (t)(x(t))} >Q we appeal 
to the Hadamard-de la Vallce Poussin criterion in Proposition 6.1. Since the function 

] - l,oo[ 3 r i — > r^r- — — S 



A,(l + r)T 



is continuous, by (U3) there exists S > such that X^'g-p 
The function <j>(r) 



clearly is convex on K^Oi and nm r 



Aj(l+5)T < 1 - 

(j>(r)/r = oo. Let us 



prove that sup t ^ E (V^( t )(x(i))) 



1+5 



< OO. 



First let us note that for each i £ No the function V^i'(x(t))l{t e [ TiiT<+1 [} is 



integrable for arbitrary t £ R^o- Indeed, 

-Sr. 



V;\#(s(t))l {t6 [ Ti , T4+l[} 



= E 
< E 
= E 



-3 n 



V^(x(t))l {te[Ti>Ti+l[} 

^(x(n))e-^^)( 1 + 5 )(*--)i {ie[TjjTi+l[} 

K^5(x(^)e-M T4 )(i-W)(*-n )E^[l {te[Ti , Tj+l[} ] 



and since Ss+i is uniform-T and independent of , we have 

E 3 " < [ 1 {te[n,'r i+ i[}] = 1 {te[r i ,oo[}P STl ('S' J :+i > t- n) 

t — Ti 



= 1- 



T 



VO 



Therefore, 



< E 



F CT 1 +f ) (^(r i ))e-^(n)(^)(*--) ((i - L_Zi) V o) l {te[n)0o[} 



By definition of <5, the right hand side of (6.10) is at most ME V g .Z..\(x(ri)) 
M := exp(min je -p Xj ■ (1 + <5)T). Lemma 6.6 with n = 5 shows that 



(6.10) 
where 

(6.11) 
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V'erfti (x(f))l/ te r T4)n+1 ri is intcgrablc for each i\ we can therefore apply the monotone 



where r)(5) G ]0,1[ by construction. By (6.10) we know that the random variable 

1+5 
r(t) 

convergence theorem to arrive at 

,1+51 



{v„ ( tMt))Y 



1+5 



H^(*)( 2; W) 1 {*6[r ! ,n +1 [} 

oo 
-t=0 

^E[^(x(t))l {t6[Ts , Ti+1 



(6.12) 



We know from (6.11) that E V*± 5 (x(t))l {te[r ., T . +l[} < Ma 1 ^ 6 (\\x \\)n l (S) for each 
i G No- Substitution in (6.12) leads to 

oo 

\v a{t) (x(t))) 1+S ] = snp^lv^fi^Mteln^i} 

OO 

^supMal +s (\\x \\)Y,v\S) 



sup E 



(6.13) 



< oo. 



This shows that the family {Kr(t) (^(i))} t>0 is uniformly integrable. □ 

Lemma 6.9. Under the hypotheses of Theorem 4-3, for every v G N we have 

E[V a[Tv) {x{T v ))} 0X o (i o ), 

Proof. Fix ieNo. For t G [r,;, n+i[ and j &V, from (V2') we have 

^•(xW)<^(x(T i ))e-V(. i )(*-n). 
In particular, for £ G [t^, Tj+i[, 

^ (Ti+l) (x(i)) < ^ (Ti+l) (x(r,))e- A "<- +1 '-<-» ( *- T ' ) , 
and by continuity of x(-) and each Lyapunov function, and (V3'), 

V a[Ti+l) {x(t)) < A1 K T(rs) (a;(T J ))e- A '^+ 1 '-^) ( '- ri) 
pointwise on Q,. Therefore, 



5 r i 
E Ti [V aiTi+l) (x{T i+1 ))\ ^ fiV a(Ti) (x{n))E 



3^ 



^(T i+ i),^(T i )5 , i+i 



(6.14) 



(GH3) shows that Si+i and o^Ti+i) are conditionally independent given $ Ti , and 
therefore, 



-3+ 



Since cr(Ti) is J Ti -measurable, 



]%),i<^E E [ e " Ai, ' Sl ] 



jev 



Pk,j- 



jev 
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By (G3) there exists a 6 € ]0, 1[ such that the quantity on the right hand side of the 
above inequality is at most 6 j ft. Therefore, we get 



EC 



<0< 1, 



which in view of (6.14) shows that 

^[V a{Ti+l) (x(T l+1 ))] < ev a{Ti) (x(n)). 

Fixing v G N, since (Tj)jgN is an increasing sequence of (5 r t )t^o _0 pti° na l times, it 
follows from standard properties of conditional expectations 3 



•E 



3r„ 



■E 



3V„ 



dt < 



E[K(r„)(^(r,))] =E 

< E 

< 0"V ao {x Q ). 
This proves the assertion. □ 

/>oo 

Lemma 6.10. Under the hypotheses of Theorem 4-3 we have / ai(||x(f)||) 

Jo 

a.s. 

Proof. Following the proof of Lemma 6.7 we have 

oo 

E[V a{t) (x(t))} =J2^[V a(t) (x(t))l {te{Ti!Ti+ll} ] . 



From (VI'), the monotone convergence theorem, and two applications of Tonclli's 
theorem, (as in the proof of Lemma 6.7,) we get 



ai (\\x(t)\\)dt 



< / E[V„ W (x(t))dt] =£e 



i=0 



V a{t) {x{t))dt 



(6.15) 



Now by (V2') we get 

1+1 V a[t) (x(t))dt 



^ E 



V a(iTt) (x{ Ti ))E 



V a ( Ti )(x(n)) 



5t, 



Ti + l 



Q- X <y{T i ),a{T i ){i-r i ) fa 



1 - E' ,Ti [e _ACT(T *>' < '( T i>' s ' i + 1 ] 

^cr(T i ),(T(r i ) 



Note that the non-degeneracy of the matrix Q yields E[e _Ai>i x ] < oo for all i G V . 
This together with the fact that o(ji) is -measurable, guarantees the existence of 
a constant M > 0, such that 



Tj+1 



V a{t) {x(t))dt 



^ ME[V a{Tt) (x(n))] 



Substituting in (6.15) we arrive at 



ai (\\x(t)\\)dt 



<^ME[K (ri) (x(T,))] < Ma 2 (\\x \\)^ 



< oo 



i=0 



in view of Lemma 6.9 and (V3'). We immediately get P( J °° ai(||x(i)||) dt < oo) = 1, 
as asserted. □ 



3 The property being utilized is the following: If t and r' arc (5 r t)t^o _0 Ptional times, and r r', 
then is a sub-sigma-algebra of J5V'- See e.g., [24, Chapter 6] for further details. 
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6.2. Proofs of the Results in §3 and §4. As stated at the beginning of §6, 
the proofs of Theorem 3.4 and Corollary 3.5 are carried out in detail below, following 
which we provide sketches of the proofs of Theorem 3.2 and Corollary 3.3. 

Proof of Theorem 3.4- To see the property (AS2) of (2.2) we note that by 
Lemma 6.7, P( / °° ai(||x(£)||) d£ < oo) = 1. Lemma 6.5 now shows that ||x(£)|| — > 
a.s. as £ — > oo since a\ £ /Coo- Since xo was arbitrary, to establish (AS2) it only 
remains to show that the solutions corresponding to all initial conditions x' with 
||xq|| < ||xo|| are also asymptotically convergent. To this end, observe that for every 
fixed u> G Q, v G N, and £ G [t u (u>), t v +i(lj)[, a straightforward computation with the 
aid of (V1)-(V3) gives 



Vr 



V-l 

. (tiU) (s(t,w)) s;a 2 (||a:o||)^n e ' 

i=0 



Aa(T 4 M,u.)Si+i(w) -A a ( TvMtU ,)(t-Ti/(w)) 



(6.16) 



Here x(-,u>) corresponds to the solution of (2.2) initialized at xq. If x'(-,u>) denotes 
the solution corresponding to the initial condition x' Q , then from (6.16) we have 



V a{t ,„){x' (t,w)) <a 2 (||x ||K I 



i=0 



whenever ||x || < ||xo||j since the right-hand side of (6.16) depends on the initial 
condition only through the function a 2 , which is monotone increasing. This proves 
(AS2). 

Now we verify (AS1). Fix e > 0. We know from the (AS2) property proved 
above that almost surely there exists T(l,e) > such that |jx | < 1 implies that 
supine) ||z(*)|| < £■ Select 8(e) = min {ee~ L ' T ^^\ l}. By Lemma 6.4, ||a;o|| < 
5(e) implies 

||x(t)|| < ||x ||e 1 «*<%)e L « T ( 1 ' e )<e V£ G [0, T(l, e)]. 

Further, the (AS2) property guarantees that with the above choice of 8 and xo, we 
have supj^y^ e j ||x(£)|| < e for events in a set of full measure. Thus, ||a;o|| < 8(e) 
implies that sup t ^ ||x(£)|| < e a.s. Since e is arbitrary, the (AS1) property of (2.2) 
follows. 

We conclude that (2.2) is GAS a.s. □ 

Proof of Theorem 3.2 (Sketch). First we observe that under the hypotheses of 
Theorem 3.2, for each j £ N we have 

V a^)( x ( T i))] < a 2 +K (\\ x o\\W(K) whenever (1 + k)A, + A > for all i G V, 



where t](k) := — 



+ Aj(l + k)/X 



, k > 0. This can be proved along the lines of 



Lemma 6.6. In particular, at the step corresponding to (6.5) we employ the (E3) 
condition (1 + k) mimg-p Ai + A > as 



-A«, (T . 4) (l+K)S i+ i 



= E 
= E 



5r, 



e -A tT(Ti )(H-K)S i+ i 

° e -( A -(^) (1+K)+A ) s d.s 



+ (l + K)Xj/X 
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r 00 

Second we observe that / ai(||x(t)||) dt < 00 a.s. The proof is similar to that of 

Jo 

Lemma 6.7; the only difference lies in the step corresponding to (6.9), where we 
employ the condition (1 + k) min^gp A^ + A > to arrive at 



/>oc 

/ V^ (t )(£(t))l {te [ Ti , Tj+l[} df 
Jo 



^[^(x^))] - 



1 



min, e -p A, + A 



The subsequent steps follow those of Lemma 6.7 and we get 



ai (\\x(t)\\)dt 



a2(\\x \ 



mmjgp 



A, + A 



i=0 



where rj is as defined at the beginning of the current proof. With these ingredients, to 
see the property (AS2) of (2.2) we note that in view of P( J °° ai(||x(£)||) dt < 00) = 1, 
Lemma 6.5 gives ||x(i)|| — > a.s. as t — > 00 since ai € /Coo- This proves (AS2) because 
the only dependence on the initial condition is through a2(||xo||) and xo is arbitrary 
(as argued in the Proof of Theorem 3.4 above). The proof of (AS1) is identical to 
that in the proof of Theorem 3.4, and we omit the details. It follows that (2.2) is 
GAS a.s. □ 

Proof of Corollary 3.5. Our first objective is to prove asymptotic convergence of 
the net (E[ai(||x(£)||)]) t> to 0. We have proved global asymptotic convergence a.s. of 
the process (x(i)) t j>o to in Theorem 3.4, and via hypothesis (VI) this shows that the 
process (V^( t )(x(t))) (>Q also converges a.s. to since a 2 G /Coo. From Lemma 6.8 we 

know that the family {V^( t ) (x(i))} t>Q is uniformly integrable, and by Proposition 6.2 
it follows that lim^oo E[V^( t )(x(i))] = 0. This implies global asymptotic convergence 
of E [ai(||x(£)||)] to in the light of (VI), and verifies the (SM2) property with a = a\. 

It remains to prove (SMI). Following the notation of the proof of Lemma 6.8, we 
note that 77(0) € ]0, 1[ by (U3). To establish (SMI) we only need to note that with 
6 = in (6.13) we have 

BupE[^ (t) (*(*))] < Ma 2 (||x ||) 1 
t>o 1 - ?7(,tJ) 



For e > preassigned, we choose S < a 2 1 (e(l + ry(0))/M) to see that 
sup E[ai(||x(£)|Q] <£ whenever ||xo|| < 5. 

The (SMI) property with a = a\ follows, thereby completing the proof. □ 

Proof of Corollary 3.3 (Sketch). We follow the proof of Corollary 3.5 above. Since 
the proof of (SMI) is identical to that in the aforesaid proof, we give the details for 
the proof of (SM2). This involves establishing asymptotic convergence of the net 
(E[ai(||x(£)||)]) t>0 to 0. Since global asymptotic convergence of the process (x(t)) t ^o 
to has been established in Theorem 3.2, in the light of (VI) and Proposition 6.2 it 
suffices to show that the family {V a ( t ){x(t))} t>0 is uniformly integrable to conclude 
that lim. f ^ 00 E[y (T(t) (a;(£))] =0. 

To this end, we need to follow the steps of Lemma 6.8 above to establish uniform 
integrability of {V^( t )(x(t))} t>Q . Since the function ] — 1, 00 [ 3 r 1 — ► (1 + r)Xi + A 6 M 
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is continuous for each i £ V and V is a finite set, by (E3) there exists 5' > such 
that (1 + S')Xi + X > for all i £ V . Also, since the function 



J_-(-0 

is continuous, by (E4) there exists 6" > such that J2jev i+(i+S")\ - /x ^ ip -^ c ^ ^ := 
<5' A <5". The function //>(r) := r 1+s clearly is convex on IR^o, and linv^oo <ft(r)/r = oo. 
If we prove that sup t j, E (V a ( t )(x(t))) 1+S < oo, then the Hadamard-de la Vallee 
Poussin criterion in Proposition 6.1 may be applied to conclude uniform integrability 

Calculations show that the inequality corresponding to (6.10) can be written as 

V$(x(t))l mn , Ti+l[} ] <E[F j 1 +f ) (x(r ? ;))e-^'->( 1+5 ) +A )( t -^)l {te[ri , oo[} 

and that corresponding to (6.11) can be written as 



1+5, 



where tj(k) := —, J . The step corresponding to (6.12) is identical, and 

j-L 1 + Xj{\ + Kj/X 



the one corresponding to (6.13) is 
sup E\{V a(t) (x(t))) 1+5 



oo 

f>0 — L 



< sup a£ +i (||x ||) 



i=0 



< CO. 



This concludes the proof. □ 

Proof of Theorem 4-3. The proof mimics that of Theorem 3.4 above; the only 
change required here is to replace the occurrence of Lemma 6.7 by Lemma 6.10. □ 

6.3. Proof of Proposition 5.2. Proof of Proposition 5.2. Let us verify prop- 
erty (ii) of Definition 5.1 assuming that (2.2) is GAS a.s. Fix r/,r,e' > and xo £ K n 
with ||a;o|| < r. Since {fi}iev is a finite set of locally Lipschitz vector fields, there 
exists L e i > such that sup ie p im|< e / H/iO^OH ^ L e i \\x\\. Let c := j^, and define 
the sequence of time instants (sj)jeN such that sq := and Sj — Sj-i = c for every 
j £ N. By the (AS2) property of (2.2) we have P(lim f _ >00 \\x(t)\\ = 0) = 1, which 
also implies that P(limi_ +00 ||ic(si)|| = 0) = 1. By Egorov's Theorem 6.3 there exists 
a measurable set A v such that P(f2\>l J) ) < r\ and (x(si)l J 4^) i N uniformly converges 
to 0. The uniform convergence condition by definition implies that there exists io £ N 
such that sup^ io (||x(sj)|| 1a,,) < y- By construction of the sequence (sj)jgN we must 
have ||x(f)|| 1a„ < e' for all t ^ Si in view of continuity of x(-). To sec this, fix a time 
t' > Si . The construction of the sequence (sj)igN shows that there exists a j(t') £ N 
such that t' £ [sj(t')-i, s j(t')[- The local Lipschitz condition on the set of vector fields 
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{fi\i £ -p implies that 

\\x{t')\\ l An < sup \\x(s)\\ 1 A „ < ^ e £ «'(»-*'>) < £^' c = £ ', 
se[s j(t , ) _ 1 ,s Ht , ) [ 

where the last equality is true by definition of c. Since t' was arbitrary, the assertion 
follows. Since xq was arbitrary, to establish the property (ii) of Definition 5.1 it 
only remains to show that the solutions restricted to A v corresponding to all initial 
conditions x' with \\x' \\ < \\xo\\ are also asymptotically convergent. To this end, 
observe that for every fixed u> £ il, and therefore for every fixed ui £ A n , v £ N, and 
t £ \tv(lo), t„ + i(u;)[, a straightforward computation with the aid of (V1)-(V3) gives 

v-l 

V a{t ^(x(t,cj)) <a 2 (||i ||Kn c_A " (Ti( " ), " ,Si+lMe " A, ' (T, ' (u ' ), " ,(t " T '' M) - ( 6 - 17 ) 

i=0 

Here x(-,lu) corresponds to the solution of (2.2) initialized at x$. If x'(-,u>) denotes 
the solution corresponding to the initial condition x' , then from (6.17) we have 

v-\ 

V„ M (x'(t,u>)) < a 2 (||x ||K J] e^^M-i^'Me-V^wC^M) 

i=0 

whenever ||xq|| < ||;eo||j since the right-hand side of (6.17) depends on the initial 
condition only through the function ct2, which is monotone increasing. This proves 
(ii). To establish (i), let us fix 77 £ ]0, 1[ and e > 0. By (ii) there exists a T > 
corresponding to rf = 77, r = 1 and e' = r\ such that ||a;o|| < 1 implies that 
sup t>T ||a;(t)|| 1a,, < £■ The local Lipschitz condition on the set of vector fields {fi}ien 
guarantees the existence of a positive 5' > such that sup 4g j T j ||a;(t)|| < e whenever 
||xo|| < 5. Picking 5 = 1 A 5' we see that ||xo|| < S implies that sup t ^ ||a;(t)|| 1a„ < £■ 
The implication is now completely established. □ 

7. Control Synthesis. Our goal in this section is to synthesize feedback control 
functions for stabilization (in a suitable stochastic sense) of randomly switched sys- 
tems with control inputs. For brevity, we shall restrict ourselves to controllers which 
render the closed-loop switched system GAS a.s. for a switching signal of class EH. 
The results automatically give the ai-GAS-M property also in addition to GAS a.s., in 
view of the close relationship between the sufficient conditions for GAS a.s. and GAS-M 
in our analysis results of §3. 

There are two distinct and obvious controller architectures: one in which the 
the control function depends on the switching signal a, and the other in which the 
control function does not depend on a. In the first case, which is presented in §7.1, we 
combine universal formulae for feedback stabilization of nonlinear systems with our 
analysis results to design controllers which ensure GAS a.s. of the closed-loop switched 
system. In the second case, which is presented in §7.2, we search for a controller which 
stabilizes some subsystems while not destabilizing the others too much, and with the 
aid of our analysis results, ensure that the closed-loop switched system is GAS a.s. 

7.1. Mode-dependent Controllers. Consider the affme-in-control switched 
system 

m 

i = fa(x) + 229a,j(x)uj, (x(0),cr(0)) = (x ,a ), t^O, (7.1) 



STABILIZING RANDOMLY SWITCHED SYSTEMS 



19 



where x £ K™ is the state, itj, i = 1, . . . , m, are the (scalar) control inputs, fi and gij 
are twice continuously differentiable vector fields on R™, with fi(Q) ~ 0, (^ (O) = 0, 
for each i € V,j € {1, . . . , m}. Let hi be the set where the control u := [ui, . . . , it m ] T 
takes its values. With a feedback control function k a (x) = [k ay i(x), . . . , fc (Tjm (x)] T , the 
closed-loop system stands as: 



x = f <T {x)+^g <T , j {x)k< r , j {x), (x(0),a(0)) = (x ,a ), t^Q. (7.2) 



We now describe the controller design methodology. A universal formula for stabiliza- 
tion of control-affine nonlinear systems was first constructed in [26], for the control 
taking values in hi — W n . The articles [20], [21], and [22] provide universal formulae 
for bounded controls, positive controls, and controls restricted to Minkowski balls, 
respectively. In view of the analysis results of §3 and the universal formulae provided 
in the aforementioned articles, it is possible to synthesize controllers k a for (7.1) such 
that the closed-loop system (7.2) is GAS a.s. In general, we obtain one synthesis 
scheme for each type of hi. The following theorem provides a typical illustration of 
such a result for the case hi = M m ; a complete recipe to obtain such results in other 
cases is provided in Remark 7.2. 

Theorem 7.1. Consider the system (7.1), with hi = K m . Suppose that a is 
of class EH, and there exists a family {Vi}i<=-p of twice continuously differentiable 
real-valued functions on K n , such that 
(CI) (VI) of Assumption 2.3 holds; 
(C2) (V3) of Assumption 2.3 holds; 
(C3) 3{\ l } iev C ffi such thatVx G K™\{0}, Vie V, 



(C4) Ve > 38 > such that if x(£ 0) satisfies \\x\\ < S, then 3u e K m , ||u|| < e, 
such that V i E V , A 




m 



I-/ V + X! "./ • L 9i,i V i < -VI ,: 



(C5) (E3)-(E4) of Theorem 3.2 hold. 
Then the feedback control function 



k a (x) — [k a i (x), . . . , k a m (x)] 



T 



where 




(7.3a) 
(7.3b) 




(7.3c) 



4 This is known as the small-control property [26]. 
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and 

V {a,b):=l I l}b (7.3d) 

I otherwise, 

renders (7.2) GAS a.s. 

Proof. The proof relies heavily on the construction of the universal formula in [26] . 
Fix t G R^o- If x 7^ 0, applying the definition of ip, we get 



L /„( t ) V<,(t) (x) + ^2 k °{t),i ( X ) L 9 H t),, V cr(t) (x) 
i=l 



< -A CT ( t )K-( t )(x). 

Since i is arbitrary, we conclude that the above inequality holds for all t G R^o- 
Note that by (C3), if x G Hjli ker (L ffi ^ V^J for any i E V, we automatically have 
L/ , t) Va-(t)(x) + \ a (t)V<j(t)(x) < 0- The above arguments, in conjunction with (CI) 
and (C2) enable us to conclude that the family {Vi}i^-p satisfies Assumption 2.3 for 
the closed-loop system (7.2). (El) and (E2) hold by hypotheses. The assertion now 
follows from Theorem 3.2. □ 

Remark 7.2. Theorem 7.1 can be modified to suit a different control set U and a 
different type of a using the following simple recipe. First, recall from the discussion 
preceding Theorem 7.1 that U may be any one among R m , the nonncgative orthant 
of R m , the unit ball (with respect to the Euclidean norm) of R m , and a Minkowski 
ball in R m . Now suppose that a U is given to us, and let a belong to class UH. Then: 
(Rl) (CI) and (C2) remain unchanged; 
(R2) the given U replaces the U = R m in Theorem 7.1; 
(R3) (U3) replaces (E3)-(E4) in (C5); 

(R4) the universal formula corresponding to the given hi replaces the one given 
in (7.3). < 

7.2. Mode-independent Controllers. Consider the affine-in-control switched 
system (7.1). Let k(x) = [fci(x), . . . , k m (x)] T be a feedback control function, with 
which the closed-loop system stands as: 



f (T (x)+J29a, j (x)k j (x), (x(0),a(0)) = (x ,a ), * > 0. (7.4) 

3=1 



Theorem 7.3. Consider the system (7.1) withhi = R m . Suppose that a belongs 
to class EH, and there exists a family {Vi}iep of twice continuously differ entiable 
real-valued functions on R n such that 

(i) (VI) and (VS) of Assumption 2.3 holds; 

(ii) there exists a control function k : M™ — > 14, such that Lj\_|_ -j^Vi(x) —XiVi(x) 
for every i G V , x G R", for some {A;}i g p C R; 

(iii) (E3)-(E4) of Theorem 3.2 holds. 
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Then k renders (7.1) GAS a.s. in closed-loop. 

Note that this result does not need a feedback controller k that simultaneously 
stabilizes the family (2.1), which in general is difficult to get; it proposes controllers 
which may leave some subsystems unstable, but nonetheless achieve GAS a.s. of the 
closed-loop switched system. 

Proof of Theorem 7.3. The assertion follows immediately by first observing that 
the closed- loop system is (7.4), and then applying Theorem 3.2 to (7.4). Indeed, note 
that hypothesis (ii) holds for (7.4) by our assumption on a, (iii) implies (EH3)-(EH4) 
hold, and (i)-(ii) ensure that (El) holds. □ 

8. Conclusion and further work. We have established sufficient conditions for 
global asymptotic stability almost surely, in the mean, and in probability, of randomly 
switched systems and a methodology for almost sure global asymptotic stabilization 
and global asymptotic stabilization in the mean of randomly switched systems with 
control inputs. The switching signals were assumed to be semi-Markovian. 

An interesting research direction is to extend the above results to systems with 
disturbance inputs. The analysis becomes more involved, and for synthesis tools 
universal formulae for iss disturbance attenuation in nonlinear control literature are 
needed. Some preliminary results have been reported in [8] and [6] . In the particular 
case of Markovian switching signals, one can prove stochastic analogs of input to state 
stability (iss) [6, Chapter 3]. 

Acknowledgments. The authors are grateful to Sean P. Meyn and P. R. Kumar 
for motivating the results of §4, and V. S. Borkar for helpful discussions. 
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